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(54)Tiae: MOrnON-COMPENSAlED FIELD RATE CONVERSION 
(57) Abstract 



In a method of processing input fields (I) of a 
picture signal to obtain interpolated fields (O) located 
temporally between the input fields (b, motion 
vectors (MV) are provided (30) between input fields 
(I), whereafter a quality (Err) of the modon vectors 
(MV) is assessed (40). In <tependence upcm the 
assessed qiiality (&r), the modon vectors (MV) are 
ad^tated (50, 60) such that both decreased and 
increased motion vector lengths occur in respective 
interpolated fields (O). The interpolated fields (O) are 
obtained (20) from the iiqput fields (I) in dependence 
upon the thus adapted motion vectors (k*MV)» 
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MbubD-compensated field rate conversion. 



The invention relates to a motion*compensated field rate conversion, in 
whi(A interpolated fields are obtained from input fi^^ 

^ ^ EP-A-p,475,499 discloses a system for field rate conversion in which the 

mterpolated pictures resuh as shifted input fields. It is mentioned that, dependmg on the 
reliability of the motion vectors, the compensation can be more or less complete. In other 
words: if motion vectors are unreliable their effect is reduced by muhiplying them with a 
factor smaller than one. In the described case of a field rate doublcr, the result is some 50 

10 Hz motion judder which is not very <rt)jectionable and can be interpreted as a velocity 
dq>ending blurring. 

In field rate convenors with a higher or a non-integer ratio between the 
input and the output field rate, di» effect of reduced motion compensation is the breakthrough 
of a much lower frequency in the motion judder. This frequem^ equals the largest common 

15 factor of die output and the input field rate. For example, an up*conversion from 24 Hz film 
material to 60 Hz video material, introduces a 12 Hz component in the motion judder. Apan 
from this long rq)etition period of the judder, die motion portrayal often is very irregular. 

20 It is, inter alia, an object of the invention to provide a motion- 

compensated interpolation in which this disturbance is reduced. To this end, a first aspect of 
the invention provides a method as defined in claim 1. A second aspect of the invention 
provides an apparatus as defined in claim 4, A third aspect of the invention provides a 
television signal receiver as defined in claim 5. Advantageous embodiments are defined in 

25 the dependent claims. 

In a method of processing input fields of a picture signal to obtain 
interpolated fields located temporally between the i^put fields, motion vectors are provided 
between successive iiq>ut fields, whereafter a quality of the motion vectors is assessed. In 
accordance with the present invention, the motion vectors are adapted in dependence upon 
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the assessed quality, whereby both decreased iand increased motion vector lengths occur in 
respective interpolated fields. Hie interpolated fields are obtained from the input fields in 
dependence upon the thus ad^ted motion vectors. 

Thus, if the estimated motion vectors are not believed to be sufficiently 
S reliable for use in a straightfcvward motion-compensated interpolation, there is provided a 
(partial) feU-badc at a regular motion judder, preferably of die highest possible frequency. 
i.c. half the ou^ut field frequency. This judder^« as. any other, decreases die visibility of 
artifacts in die ptoture due to unreliable motion vectors, but as such is much less annoymg 
than the irregular and more low-frequent judder resultmg from a . straightforward down- 
10 scalmg of the motion vectors as m die prioir art. The present invention is applicable to field 
rate conversions between any iiqjut and.ouq>ut rate, and has the somewhat surprising 
property that the implied vector shifts are enlarged for some of the ouq>ut fields. ■-■ 

When input video fields are motion compensated to realize video data at a 
certain output field frequency, the common procedure is to take information from the 
15 temporally nearest input fields (or from the two fields on either side of the required temporal 
instance) aiul to shift diis data such diat objects are positioned at die motion trajectory, i.e. 
the iinaginary line through the time-position graph of the object. Depending on the temporal 
distance between the available field and die required field, die lengdi of die motion vectors as 
calculated between successive uiput fields has to be divided by a factor. In die proposed 
20 global fall-back alg(Hidim, diis fector is adapted such diat die position of moving objects is 
field altematingly above or below die motion trajectory. Consequendy, motion vectors are in 
some fields reduced, but in odier fields enlarged. Preferably, diis adaptation of die motion 
vector lengdis is not sunply field alternating, but depends cm die ratio between input and 
output field rate and on die choice of die input field(s) tiiat is used after shifting over die 
25 estimated motion vector to provide the ouqiut field. 

These and other aspects of the mvention will be sqiparent from and 

elucidated widi reference to die embodiments described hereinafter. 



30 In the drawings: 

Fig. 1 illustrates a global fall-back according to the invention in the case 
of a 25 Hz fUm to 100 Hz video conversion; 

Fig. 2 illustrates the global fall-back mode according to the present 
invention for die case of a 24 Hz (film) to 60 Hz (video) conversion; 




WOM/3357i 2 PCT/IBM/00230 

Fig . 3 illustrates an implementation of the global fall-back measure for a 
60 Hz to 50 Hz field late conversion; 

Fig. 4 Ulustrates a first embodiment of a motion-^ 
intexpolation circuit in accordance with the present invention; 
S Fig; 5 illustrates a second embodinient of a motion*compensated 

interpolation circuit in accordance with the present invention; a^ 

Fig. 6 shows an embodiment of a televisibh receiver in accordance with 
the preseiit' invention. 

10 ■ ' \ ■ : . 

Fig. 1 an example is provided for the case of 25 Hz film to 100 Hz video 
up*conVersion applying shifts to one nearby input field only. The horizontal axis indicates the 
field number, while the vertical axis indicates the position. Assuming a straight non- 
accelerated movement, ah c*ject would move along the motion trajectory MT, which is to be 

15 understood as a straight line drawn such that the deviation of the actual positions of the 
object in successive fields from this straight line is minimal on average; of course, this line 
nmy be shifted in time which shift corre^onds to an overall processing delay. The small 
blade circles indicate the position of an object in the 25 Hz input fields. The arrows indicate 
the motion vectors which are supposed to shift the object to die motion trajectory. However. 

20 when the motion vectors are not believed to be sufficiendy reliable to be used without any 
further measures, the fall-back according to the present invention becomes active. As shown 
in Fig. 1, in die fall-back case/ the motion vectors are twice enlarged (+), than twice shrunk 
(-), etc, so as to obtain positions of the moving object which are field*altematingly above or 
below the motion trajectory MT. As indicated by the thus adapted arrows in the figure, 

25 exacdy 50 movement phases per second result, i.e. the objects position in two successive 
fields is identical. This is just a choice, smaller and also larger deviations from the exact 25 
to 100 Hz compensation are also possible. The choice may depend on the reliability of the 
motion vectors: the worse the (global) reliability, the larger the deviation from the ideal 
compensation in which all arrows would end on the motion trajectory MT. 

30 

Fig. 2 shows a second example, where the current invention is elaborated 
for the case of 24 Hz film to 60 Hz video conversion. The large circles indicate the positions 
l>efore compensation, while the small circles indicate the positions obtained after a partial 
motion-compensated interpolation according to the present invention. The large circles are 
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formed by a standard 2-3 pull down conversion to obtain 60 Qutput fields from 24 input 
fields. Again, in case of unreliable motion vectors, the motion vectors are adapted such that 
theipositions of the moving object are fieid-alternatingly at^one side or the other of the 
.motion trsyectory MT. • .... .. .^--rh ::: ^^i^.k... 

5 ••- ... ■ ..... .. -vrv::C:..:^ . . • • • ■ 

Fig. 3 shows how the same idea y^^ 
: . field rate cony»si6n.:.T^ figure shows the priginal positioh^o^ the (uq>ut) material in the 
first row (1), the fully compensated 60 Hz ou^ut in the last row (3),. and between them, in 
row 2, the ''partially corrected" mterpolation result according to die present invention. Row 3 

10 is obtained with a straightforward motion*conq)ensated interpolation which can be used when 
the estimated motion vectors are sufficiendy reliable. Row 2 shows positions which are 
altematingly at the right-hand side and at the left-hand side of the corresponding positions in 
row 3. A position at the right-hand side of the corresponding position in row 3 is obtained by 
an enlarged motion vector, while a position at the left-hand side of the, corresponding 

IS position in row 3 is obtained by a decreased motion vector. 

In one particular embodiment, adapted scaling of the motion vectors was 
made dependuo^ on the measured contrasts in the velocity plane. If the x-component of two 
horizontally neighboring displacement vectors or the y-component of two vertically 

20 neighboring displacement vectors differed more than a first threshold value, a slight deviation 
from the scaling as required for a perfect motion con4)ensation was introduced. If the 
difference was more than a second threshold the scaling was further adapted and so on. 
Obviously , any number of thresholds can be used m the implementation. The background of 
this particular adaptation is that the global reliability of motion vectors m a scene is expected 

25 to decrease if there are criijects moving fast in different dkections close to each other (input 
material grows more difficult with increasing velochies and particularly if the velocity field 
contains large contrasts). How. rapidly the glc4>al vector reliability decreases depends on the 
2^plied estimation algorithm which therefore will determine the optimal thresholds to be 
used. 

30 

Fig. 4 illustrates a first embodiment of a motion-compensated 
interpolation circuit in accordance with the present invention, in which an interpolated output 
field O is obtained by shifting a single input field I along the motion trajectory. The input 
signal is applied to a motion vector controllable variable delay circuit 20 thru a time base 
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corrector (TBC) 10. A motion estimator (ME) 30 funiishes motion vectors MV. A fail-back 
detection circuit 40 is coupled to the motion estiniator 30 to receive an error signal Err 
indicative of the consistency in the motibh vector fields the estimation match errors, or some 
odiier information useful for detennining tb^ reliability of the estimated motion vectors. The 

5 fidl-back detection circuit 40 detmnines whether the error signal &r deviates seriously 
enough from accq>table vkliies and, if so, sigiimls to a vector modifier 50 that the motion 
vectors MV produced by the motion estimator 30 should be adapted such that the visibility of 
inotion estimation errors is reduced. The vector modifier SO produces a vector length 
modifying factor k which is ^lied to a vector multiplier 60 for multiplying the horizontal 

10 and vesical components of the motion vectors MV from the motion estimator 30 by this 
factor k. It goes without saying that if no ad24>tation is necessary, the vector length 
modifying factor k solely depends on the temporal position of the interpolated field with 
regard to the corresponding input field. The thus modified motion vectors k*MV are applied 
to the variable delay 20 for controlling the motion vector dependent shift. The variable 

IS delay 20 produces the ou^ut fields O. 

As mentioned above, if the motion vectors are to be adapted to reduce the 
visibility of motion vector estimation errors, they should be ouq>ut-field-altematiiigly adapted 
such that the positions of moving objects are at alternating sides of ttie motion trajectory. To 
this end, the vectt>r modifier SO receives an odd/even field identifier signal o/e. A field may 

20 be interlaced or non*interlaced. 

Fig. S illustrates a second embodiment of a motion*compensated 
interpolation cvcuit in accordance with the present invention, in which an interpolated output 
field O is obtained by shifting two input fields I along the motion trajectory, and averaging 

25 tht thus shifted input fields. The embodiment of Fig, S is much alike that of Fig. 4, so that a 
description of only the differences between these embodiments will suffice. The ouqjut signal 
of the time base corrector 10 is also applied to a second variable delay 20* through a field 
delay 15. The motion estimator 30 of Fig. 4 is replaced by a motion estimator 30' which 
produces, in addition to the above-mentioned motion vectors MV, motion vectors MV' for 

30 use with the other input field. The vector modifier 50 of Fig. 4 is rq>laced by a vector 
modifier 50' which produces, in addition to the above-mentioned factor k, a vector lengtii 
modifying factor 1-k for use with the otiier itxput field. When two input fields are used in a 
motion-compensated interpolation, it will be clear tiiat if the motion vectors MV to be used 
with one of these input fields are shortened (or made longer) by a factor k, the motion 
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' y 

vectors MVv to be used with the ;pther field are to be made longer (or shortened) by a " 
corresponding factor 1-k. A vector multiplier 60' multiplies the horizontal and vertical 
, components of the motion vectors MV* from the motion estimator 30' by this factor 1-k. The 
V Aus modified motion vectors (l-k)*My; are applied to the variable delay 20* for controlling 
5 ^ its motion vectpr (lependent shift. An averager 23 receives respective niotion-compensated 
^ shifted fields from the variable delays 20 and 20*. for producing the ou^ut field O. 

Fig. 6 shows ah embodiment of a television receiver in accordance with 
die present invention. A tuner and IF circuit 100 receives antenna signals and furnishes 
10 demodulated video signals to a video processor 200. The video processor does all usual 
things like brighmess and contrast control, and furnishes processed video signals as an input 
picture signal 1 to an upconverter 300 which may be either of the embodiments of Figs. 4; or 
5, to obtain interpolated output fields The upconverter 300 furnishes these inteipoiated 
output fields O to a display 400. 

15 

A main aspect of the invention can be summarized as follows. In pictures 
resulting from motion-compensated field rate convenors, artifacts resulting from motion 
vectOT estimation errors can occur in scenes with complicated or very fast motion. If these 
artifticts degrade the picture quality more than what is gained with motion compensation, it is 

20 good to gradually switch over to non-motion conqpensated interpolation. This disclosure 

describes an approach that yields considerably better results than a straightforward reduction 
of the motion vector length which is known from the prior art. In contrast with previous 
proposals, vector lengths are sometimes increased, so that both increased and deo-eased 
motion vector lengths occur in respective interpolated fields. Hereby, a motion judder is 

25 obtained which reduces die visibility of the motion vector estimation errors. 

It should be noted that the above-mentioned embodiments illustrate rather 
than limit the inventk>n, and that those skilled in the art will be able to design many 
altenuitive embodiments without depaning from the scope of the appended claims. In the 
claims, any reference signs placed between parentheses shall not be construed as limiting the 

30 claim. The invention can be implemented by means of hardware comprising several distinct 
elenients, and by means of a suitably programmed computer. Clearly, sophistications in 
which the adaptation of the deviation is only allowed to change slowly in time are possible. 
These sophistications can be useful to prevent visible switching of the introduced global blur 
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or motion error. In this disclosiire and in the claims, a field may be interlaced or inon- 
int^Iaced. 



I 

I 



W09493S71 • PCT/IB9d/00236; 



1. A method of processing iiq>ut fields (I) of a picture signal to obtain 
interpolated fields (O) located temporally between said iiq>ut fields G), the method 
comprising the stq>s of: 

providing (30) motion vectors (MV) between input fields (I); 
S assessii^ (40) a quality (Err) of said motion vectors (MV); 

adapting (SO, 60) said motion vectors (MV) in dq>endence upon said 
assessed quality (Err) to obtain adapted motion vectors (k'^MV), wherein said motion vectors 
(MV) are adapted such that both decreased and increased motion vector lengths occur in 
respective interpolated fields (O); and 
10 obtaining (20) said interpolated fields (O) from said input fields (I) in 

dependence upon said ad^ted motion vectors (k'^MV). 

2. A method as claimed in claim 1, wherein said step (40) of assessing a 
quality (Err) of said motion vectors (MV) includes the step of measuring contrasts in a 
velocity plane formed by said motion vectors (MV). 

IS 3. A method as claimed in claim 2» wherein the step of measuring contrasts 

in a velocity plane formed by said motion vectors (MV) mcludes the step of comparing 
differences between horizontal and/or vertical components of motion vectors (MV) 
corresponding to neighboring image parts » to at least one threshold value, whereby the 
motion vectors (MV) are adapted in dqiendence iq)on whether said at least one threshold 

20 value is exceeded. 

4. An s^paratus for processing input fields G) of a picture signal to obtain 

intopolated fields (O) located temporally between said iiq>ut fields (I), the apparatus 
comprising: 

means (30) for providing motion vectors (MV) between input fields (I); 
25 means (40) for assessing a quality (Err) of said motion vectors (MV); 

means (50, 60) for zdzpting said motion vectors (MV) in dependence 
upon said assessed quality (Err) to obtain ad^ted motion vectors (k*MV), wherein said 
motion vectors (MV) are ad^ted such that both decreased and increased motion vector 
lengths occur in respective interpolated fields (O); and 
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means (20) for obtaimxig said interpolated fields (O) from said input Aelds 
(I) in dependence upon said adapted motion vectors (k'^MV). 
S. A television signal receiver, comprising: 

means;(100» 200) coupled to receive a television signal for furnishing a 
picture signal; * . . 

ah apparatus (300) as defined in claim 4, for processing iqput fields (I) of 
said picture signal, to obtain interpolated fields (O); and 

display means (400) coupled to said processing spparatus (300)* 
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In a metfiod of processing input fields (I) of a 
picture signal to obtain interpolated fields (O) located 
temporally between the input fields (0, motion 
vectors (MV) are provided (30) between input fields 
(I); whereafter a quality (Eit) of the motion vectors 
(MV) is assessed (40). In dependence upon die 
assessed quality (Err), Ae motion vectors (MV) are 
adaptated (50, 60) such that both decreased and 
increased motion vector lengths occur in respective 
inteipolated fields (O). The interpolated fields (O) ate 
obtained (20) frcxn the input fields (I) in dependence 
upon die thus adapted motion vectors (k*MV). 
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